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APPROACH FOR ESTIMATING USER RATINGS OF ITEMS 

RELATED APPLICATIONS 

This application is a continuation-in-part application of and claims priority to U.S. 
Patent Application Number 09/561,041 entitled "Method and Apparatus for Renting 
Items " filed on April 28, 2000, by Reed Hastings, Marc Randolph, and Neil Hunt, the 
5 entire contents of which are incorporated herein by reference in their entirety for all 
purposes. This application also claims priority to U.S. Provisional Patent Application 
Number 60/212,193 entitled "Approach for Choosing Items to Recommend Based Upon 
Matching Taste Across Multiple Users and Items" filed on June 16, 2000, by John 
Ciancutti, Reed Hastings, Neil Hunt and Stan Lanning, the entire contents of which are 
10 incorporated herein in their entirety by reference for all purposes, and also claims priority 
to U.S. Provisional Patent Application Number 60/244,793 entitled "Approach for 
Renting Content" filed on October 31, 2000, by W. Reed Hastings, Neil Duncan Hunt 
and Marc B. Randolph,, the entire contents of which are incorporated herein in their 
entirety by reference for all purposes. 

15 FIELD OF THE INVENTION 

The present invention relates to inventory rental, and more specifically, to an 
approach for estimating user ratings of items. 

BACKGROUND OF THE INVENTION 

Conventional inventory rental models are typically based upon renting items for 
20 fixed rental periods and charging late fees for keeping rented items beyond a specified return 
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date. As used herein, the terni "item" refers to any item of conraierce. These types of 
inventory models suffer from several significant limitations. First, conventional rental 
models require customers to make the decision of what items to rent at substantially the 
same time as the decision of when to rent the items. An example that illustrates this 
5 hmitation is a video rental business. Customers go to a video rental store and select 

particular movies to rent at that time. The customers take the movies home and must return 
them by a particular due date or be charged a late fee. Li this situation, the customers cannot 
decide what movies to rent before actually renting them. The customers may have a 
particular movie in mind, but there is no guarantee that the video rental store has the 
10 particular movie in stock. Moreover, due dates are inconvenient for customers, particularly 
for "new release" movies that are generally due back the next day. 

Given the current demand for inventory rental and the limitations in the prior 
approaches, an approach for renting items to customers that does not suffer from 
limitations associated with conventional inventory rental models is highly desirable. In 
15 particular, an approach for renting inventory items to customers that allows separation of 
customers' decisions of what items to rent from when to rent the items is highly desirable. 

There is a further need for an approach for renting items to customers on a 
continuous basis that avoids the use of fixed due dates or rental "windows" appurtenant to 
conventional rental models. 
20 There is yet a further need for an approach for renting movies, games and music 

to customers that is more convenient and flexible to customers than conventional 
approaches. 
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There is also a need for an approach for estimating how a user would rate an 1 
that the user has not yet rated. 
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SUMMARY OF THE INVENTION 

According to one aspect of the invention, a computer-implemented method is 
provided for estimating how a user would rate an item that the user has not yet rated. 
One or more items that have been rated by the user are identified. One or more other 
5 users are identified that have rated the one or more items and given ratings to the one or 
more items that are substantially similar to ratings given by the user to the one or more 
items. Finally, an estimating is made how the user would rate the item that the user has 
not yet rated based upon how the one or more other users rated the item. 

According to another of the invention, a computer-implemented method is 

1 0 provided for selecting a particular movie to be recommended to a user for rental. A first 
set of one or more movies that have been rated favorably by the user is identified. One or 
more other users are identified that have rated the first set of one or more movies 
favorably and given ratings to the first set of one or more movies that are within a 
specified amount of ratings given by the user to the first set of one or more movies, A 

15 second set of one or more movies is identified that the one or more other users have rated 
favorably compared to the first set of one or more movies, wherein the second set of one 
or more movies have not been rated by the user. Finally, the particular movie is selected 
fi-om the second set of one or more movies. 

According to another aspect of the invention, an apparatus is provided that 

20 includes a memory configured to store data and an estimator mechanism 

communicatively coupled to the memory. The estimator mechanism is configured to 
estimate how a user would rate an item that the user has not yet rated by identifying one 
or more items that have been rated by the user, identifying one or more other users that 
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have rated the one or more items and given ratings to the one or more items that are 
substantially similar to ratings given by the user to the one or more items, and estimating 
how the user would rate the item that the user has not yet rated based upon how the one 
or more other users rated the item. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

Embodiments of the invention are illustrated by way of example, and not by way 
of limitation, in the figures of the accompanying drawings and in which like reference 
numerals refer to similar elements and in which: 
5 FIG. 1 is a diagram depicting an approach for renting items to customers 

according to an embodiment. 

FIG. 2 is a flow diagram depicting an approach for renting items to customers 
according to an embodiment. 

FIG. 3 is a flow diagram depicting a "Max Out" approach for renting items to 
10 customers according to an embodiment. 

FIG. 4 is a flow diagram depicting a "Max Turns" approach for renting items to 
customers according to an embodiment. 

FIG. 5 is a diagram depicting an approach for renting audio/video items to 
customers over the Internet according to an embodiment. 
1 5 FIG. 6 is a flow diagram illustrating an approach for renting audio/video items to 

customers over the Internet using both "Max Out" and "Max Turns" according to an 
embodiment; 

FIG. 7 is a block diagram depicting an item space according to an embodiment of 
the invention; 

20 FIG. 8 is a flow diagram that depicts an approach for estimating how a user would 

rate an item that the user has not yet rated according to an embodiment of the invention; 
and 

FIG, 9 is a block diagram of a computer system upon which embodiments of the 
invention may be implemented. 

25 
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DETAILED DESCRIPTION OF THE INVENTION 

In the following description, for the purposes of explanation, specific details are 
set forth in order to provide a thorough understanding of the invention. However, it will 
be apparent that the invention may be practiced without these specific details. In other 
5 instances, well-known structures and devices are depicted in block diagram form in order 
to avoid unnecessarily obscuring the invention. 

Various aspects and features of example embodiments of the invention are 
described in more detail hereinafter in the following sections: (1) functional overview; 
(2) item selection criteria; (3) item delivery; (4) "Max Out"; (5) "Max Turns"; (6) 
10 inventory management; (7) item recommendation; and (8) implementation mechanisms, 

1 . FUNCTIONAL OVERVIEW 

FIG. 1 is a block diagram 100 that illustrates an approach for renting items to 
customers according to various embodiments described herein. As used herein, the term 
"items" refers to any commercial goods that can be rented to customers. Examples of 

15 items include movies, music and games stored on a non-volatile memory such as a tape, 
other magnetic medium, optical medium, read-only memory or the like, and the invention 
is not limited to any particular type of item. In general, the decision of what items to rent 
is separated from the decision of when to rent the items. Customers may specify what 
items to rent using one or more item selection criteria separate from deciding when to 

20 receive the specified items. Furthermore, customers are not constrained by conventional 
rental "windows" and instead can have continuous, serialized rental of items. 

According to one embodiment, a customer 102 provides one or more item 
selection criteria to a provider 104 over a link 106. Link 106 may be any medium for 
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transferring data between customer 102 and provider 104 and the invention is not limited 
to any particular medium. Examples of link 106 include, without limitation, a network 
such as a LAN, WAN or the Internet, a telecommunications link, a wire or optical link or 
a wireless connection. 

5 The item selection criteria indicate items that customer 102 desires to rent from 

provider 104. In response to receiving the item selection criteria from customer 102, 
provider 104 provides the items indicated by the item selection criteria to customer 102 
over a delivery channel 108. Delivery channel 108 may be implemented by any 
mechanism or medium that provides for the transfer of items from provider 104 to 

10 customer 102 and the invention is not limited to any particular type of delivery channel. 
Examples of delivery channel 108 include, without limitation, mail delivery, courier 
delivery or delivery using a delivery agent. Provider 104 may be centralized or 
distributed depending upon the requirements of a particular application. 

According to an embodiment, a "Max Out" approach allows up to a specified 

15 number of items to be rented simultaneously to customer 102 by provider 104. 

According to another embodiment, a "Max Turns" approach allows up to a specified 
number of item exchanges to occur during a specified period of time. The "Max Out" 
and "Max Turns" approaches may be used together or separately with a variety of 
subscription methodologies. 

20 The approach just described for renting items to customers is now described with 

reference to a flow diagram 200 of FIG. 2. After starting in step 202, in step 204, 
customer 102 creates item selection criteria. In step 206, customer 102 provides the item 
selection criteria to provider 104. In step 208, in response to provider 104 receiving the 
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item selection criteria from customer 102, provider 104 provides one or more items 
indicated by the item selection criteria to customer 102. The process is complete in step 
210. 

2. ITEM SELECTION CRITERIA 

5 The one or more item selection criteria provided by customer 102 to provider 104 

indicate the particular items that customer 102 desires to rent from provider 104. Thus, 
the item selection criteria define a customer-specific order queue that is fiilfiUed by 
provider 104. According to one embodiment, the item selection criteria specify attributes 
of items to be provided by provider 104 to customer 102. Item selection criteria may 
10 specify any type of item attributes and the invention is not limited to particular item 
attributes. Examples of item attributes include, without limitation, identifier attributes, 
type attributes and cost attributes. Item selection criteria may be changed at any time to 
reflect changes in items that customers desire to rent from a provider. 

3. ITEM DELIVERY 

15 According to one embodiment, items are delivered by provider 104 to customer 

102 over delivery channel 108 based upon item delivery criteria. More specifically, the 
delivery of items from provider 104 to customer 102 is triggered by item delivery criteria 
being satisfied. The item delivery criteria may include a wide range of criteria and the 
invention is not limited to any particular item delivery criteria. Examples of item 

20 delivery criteria include, without limitation, customer request/notification, customer 

notification that an item is being returned, customer retum of an item, the occurrence of a 
specified date, the elapsing of a specified period of time or a customer payment. 
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The item delivery criteria may be specified by customer 102 to provider 104 or 
negotiated by customer 102 and provider 104 as part of a subscription service. For 
example, a particular subscription service may include item delivery criteria that specifies 
that a particular number of items are to be delivered monthly. As another example, item 
5 delivery criteria may specify that an initial set of items is to be delivered by provider 104 
to customer 102 upon initiation of a subscription service and that additional items are to 
be delivered to customer 102 upon retum of items to provider 104. Item delivery criteria 
may be applied uniformly to all items to be delivered to a customer, or may be item 
specific. For example, item delivery criteria may specify a particular date, i.e., the third 
10 Wednesday of every month, for all item deliveries. Alternatively, separate item delivery 
dates may be assigned to each item. 

4. "MAX our 

According to one embodiment, a "Max Out" approach is used to manage the 
number of items that may be simultaneously rented to customers. According to the "Max 

15 Out" approach, up to a specified number of items may be rented simultaneously to a 
customer. Thus, the "Max Out" approach estabUshes the size of an inventory of items 
that may be maintained by customers. The specified number of items may be specific to 
each customer or may be common to one or more customers. In the present example, if 
the specified number of items is three, then up to three items may be rented 

20 simultaneously by provider 104 to customer 102. If the specified number of items are 
currently rented to customer 102 and the specified item delivery criteria triggers the 
delivery of one or more additional items, then those items are not delivered until one or 
more items are returned by customer 102 to provider 104. 
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According to one embodiment, in situations where the specified number of items 
are currently rented to customer 102 and the specified item delivery criteria triggers the 
deUvery of one or more additional items, then the one or more additional items are 
dehvered to customer 102 and customer 102 and a surcharge is applied customer 102. 
5 The specified number of items may then be increased thereafter to reflect the additional 
items delivered to customer 102 and increase the size of the inventory maintained by 
customer 102. Alternatively, the specified number of items may remain the same and 
number of items maintained by customer 102 returned to the prior level after items are 
returned to provider 104 by customer 102. When used in conjunction with the "Max 

10 Turns" approach described hereinafter, the specified number of items may be unlimited. 
The "Max Out" approach for managing the number of items that may be 
simultaneously rented to customers is now described with reference to a flow diagram 
300 of HG. 3. After starting in step 302, in step 304, one or more initial items are 
delivered to customer 102 to establish the inventory maintained by customer 102. Note 

15 that an initial delivery of items is not required and according to one embodiment, the 
inventory of customer 102 is incrementally established over time. 

In step 306, a determination is made whether the item delivery criteria have been 
satisfied. If not, then the determination continues to be made until the item delivery 
criteria are satisfied. As described previously herein, the delivery criteria may include 

20 customer notification generally, customer notification that an item is being returned, the 
actual return of an item, the occurrence of a specific date, or that a specified amount of 
time has elapsed. 
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Once the item delivery criteria are satisfied, then in step 308, a determination is 
made whether the specified number of items have been delivered. If not, then control 
returns to step 304 and one or more additional items are delivered by provider 104 to 
customer 102. If however, in step 308, the specified number of items have been 
5 delivered, then in step 310, a determination is made whether the specified number of 
items, i.e., the "Max Out" limit, is to be overridden. As previously described, the 
specified number of items may be overridden by increasing the specified number of 
items, i.e., the "Max Out" limit, to allow additional items to be delivered to customer 102 
and charging a fee to customer 102. Altematively, the specified number of items is not 
10 changed and a surcharge applied to customer 102. This process continues for the 
duration of the subscription and is then complete in step 312. 

5. "MAX TURNS" 

According to one embodiment, a "Max Turns" approach is used to rent items to 
customers. According to the "Max Turns" approach, up to a specified number of item 

15 exchanges may be performed during a specified period of time. For example, referring to 
FIG. 1, suppose that provider 104 agrees to rent items to customer 102 with a "Max 
Turns" limit of three items per month. This means that customer 102 may make up to 
three item exchanges per month. This approach may be implemented independent of the 
number of items that a customer may have rented at any given time under the "Max Out" 

20 approach. The approach is also independent of the particular item delivery criteria used. 
According to one embodiment, the "Max Turns" approach is implemented in 
combination with the "Max Out" approach to rent items to customers. Iq this situation, 
up to a specified number of total items are simultaneously rented to customer 102 and up 
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to a specified number of item exchanges may be made during a specified period of time. 
Thus, using the "Max Out" and the "Max Turns" approaches together essentially 
establishes a personal item inventory for customer 102 based upon the "Max Out" limit 
that may be periodically refreshed based upon the "Max Turns" limit selected. 
5 In some situations, customer 102 may wish to exchange more than the specified 

number of items during a specified period. According to one embodiment, in this 
situation, provider 104 agrees to rent additional items above the specified number to 
customer 102 and to charge customer 102 for the additional items. For example, suppose 
that provider 104 agrees to rent items to customer 102 v^ith up to three item tums 

10 (exchanges) per month. If, in a particular month, customer 102 requires two additional 
tums, then the two additional items are provided to customer 102 and a surcharge is 
applied to customer 102 for the additional two items. 

In other situations, customer 102 may not use all of its allotted tums during a 
specified period. According to one embodiment, customers lose unused tums during a 

15 subscription period. For example, if customer 102 has a "Max Tums" limit of four item 
exchanges per month and only makes two item exchanges in a particular month, then the 
two unused exchanges are lost and cannot be used. At the start of the next month, 
customer 102 would be entitled to four new item exchanges. 

According to another embodiment, customers are allowed to carry over unused 

20 tums to subsequent subscription periods. For example, if customer 102 has a "Max 
Tums" limit of four item exchanges per month and only makes two item exchanges in a 
particular month, then the two unused exchanges are lost and caimot be used. At the start 
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of the next month, customer 102 would be entitled to six new item exchanges, two from 
the prior month and four for the current month. 

The "Max Turns" approach for renting items to customers is now described with 
reference to a flow diagram 400 of FIG. 4. After starting in step 402, in step 404, 
5 customer 102 and provider 104 agree upon the terms of the "Max Turns" agreement. 
Specifically, customer 102 and provider 104 agree at least upon the maximum number of 
turns that are allowed in a specified period of time. 

In step 406, in response to one or more item delivery criteria being satisfied, 
provider 104 provides one or more items to customer 102 over delivery channel 108. 

1 0 Any type of item delivery criteria may be used with the "Max Turns" approach and the 
invention is not limited to any particular delivery criteria. For example, the initial one or 
more items may be delivered to customer 102 in response to a subscription payment 
made by customer 102 to provider 104, the initiation of a specified subscription period, or 
by request of customer 102 for the initial rental items. The number of initial one or more 

15 items must not exceed the terms of the "Max Tums" agreement. 

hi step 408, in response to one or more delivery criteria being satisfied, a 
determination is made whether additional items can be provided to customer 102 within 
the terms of the "Max Tums" agreement. For example, if the number of items rented to 
customer in the current subscription period is less than the agreed-upon "Max Tums," 

20 then additional items can be rented to customer 102 within the terms of the "Max Tums" 
agreement. In this situation, this determination may be made in response to customer 102 
returning one or more items to provider 104, or by customer 102 requesting additional 
items. 
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If, in step 408, a determination is made that additional items can be rented to 
customer 102 within the terms of the "Max Turns" agreement, then control returns to step 
406 where one or more additional items are rented to customer 102. If however, in step 
408, a determination is made that additional items cannot be rented to customer 102 

5 within the terms of the "Max Turns" agreement, then in step 410, a determination is made 
whether to override the current agreement terms. E so, then in step 412, the agreement 
terms are changed to allow for a larger number of terms and customer 102 is charged 
accordingly, or the terms are left unchanged and a surcharge is applied for the additional 
items to be delivered. Control then returns to step 406, where one or more additional 

10 items are delivered to customer 102. 

ff in step 410, a determination is made that the current agreement is not to be 
overridden, then in step 414, no items are delivered to customer 102 until the next 
subscription period. For example, the request for additional items may be received at the 
end of a subscription period and instead of renting the additional items immediately, they 

15 are instead delivered during the subsequent subscription period. Control then returns to 
step 406 where one or more additional items are rented to customer or the process is 
complete in step 416. 

The approach for renting items described herein is now described in the context of 
renting to customers audio/video (A/V) items, such as movies, games and music, stored 

20 on various media. FIG. 5 is a diagram 500 that depicts a set of customers 502 that desire 
to AA^ items from a provider 504. Customers 502 communicate with provider 504 over 
links 506, the global packet-switched network referred to as the "Internet," and a link 
510. 
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Links 506 and 510 may be any medium for transferring data between customers 
502 and the Internet 508 and between the Mtemet 508 and provider 504, respectively, and 
the invention is not limited to any particular medium. In the present example, links 506 
and 510 may be connections provided by one or more Internet Service Providers (ISPs) 
5 and customers 502 are configured with generic Internet web browsers. Links 506 and 
510 may be secure or unsecured depending upon the requirements of a particular 
application. 

In accordance with an embodiment, customers 502 enter into a rental agreement 
with provider 504 to rent audio/video (AA^) items 512 from provider 504 according to 

10 the "Max Out" and/or "Max Turns" approaches described herein. The invention is not 
limited to any particular approach for entering into the rental agreement. For example, 
customers 502 and provider 504 may enter into a rental agreement by mail, telephone or 
over the Mtemet, by customers 502 logging into a web site associated with provider 504. 
Customers 502 create and provide item selection criteria to provider 504 over 

15 links 506 and 510 and the Internet 508. The invention is not limited to any particular 
approach for specifying and providing item selection criteria to provider 504, For 
example, according to one embodiment, customers 502 provide item selection criteria to 
provider 504 in one or more data files. According to another embodiment, customers 502 
log onto a web site of provider 504 and use a graphical user interfaced (GUI) to specify 

20 attributes of the movies and music that customers desire to rent from provider 504. 

The item selection attributes may include any attributes that describe, at least in 
part, movies, games or music that customers 502 desire to rent For movies, example 
attributes include, without limitation, title, category, director name, actor name and year 
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of release. For games, example attributes include, without limitation, title and category. 
For music, example attributes include, without limitation, title, category, artist/group 
name and year of release. Customers 502 may identify specific movies or music by the 
item selection criteria, or may provide various attributes and allow provider 504 to 
automatically select particular movies and music that satisfy the attributes specified. For 
example, customers 502 may specify item selection criteria that include horror movies 
released in 1999 and let provider 504 automaticaUy select horror movies that were release 
in 1999. As another example, customers 502 may specify item selection criteria that 
include adventure movies starring Harrison Ford. Customers 502 may also specify an 
order or priority for the specified item selection criteria. For example, customers 502 
may specify specific movie titles and the order in which they want to receive them. As 
another example, customers 502 may specify that they want to receive a particular 
number of movies of different types. 

Once customers 502 and provider 504 have entered into a rental agreement and 
customers 502 have provided item selection criteria to provider 504, then AA^ items 512 
are rented to customers 502 over delivery channels 514 in accordance with the terms of 
the rental agreement. Specifically, according to the "Max Out" approach described 
herein, an initial set of AA^ items 512, such as movies, games and music, are delivered to 
customers 502 over delivery channels 514 according to tiie terms of the rental agreement. 
Subsequent AA^ items 512 are delivered whenever the specified item delivery criteria are 
satisfied. For example, additional AA^ items 512 may be delivered upon the remm of 
one or more AA^ items 512 to provider, a request from customers 502, the arrival of a 
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particular date, e.g., a specific day of the month, or the expiration of a specified period of 
time, e.g., fifteen days. 

In accordance with the "Max Out" approach described herein, once the maximum 
number of AA^ items 512 have been rented to a particular customer 502, then no 
5 additional AA^ items 5 12 are rented until one or more rented AA^ items 512 are retumed 
to provider 504, or unless a surcharge is applied to the particular customer 502. 
Alternatively, the rental agreement between the particular customer 502 and provider 504 
may be modified to increase the maximum number of AfV items 512 that may be rented 
simultaneously to the particular customer 502. 

10 The rental agreement between customers 502 and provider 504 may also specify a 

maximum number of turns in combination with the "Max Out" approach. In this 
situation, a maximum number of turns restricts how quickly customers 502 may refresh 
their AA^ item 512 inventories. For example, suppose that a particular customer 502 
agrees with provider 504 to rent up to four movies with a maximum of four turns per 

15 month. Under this agreement, the particular customer 502 may maintain a personal 

inventory of up to four movies and rent four new movies per month. Thus, the particular 
customer 502 can completely "replace" his personal inventory once per month. If the 
particular customer 502 agreed to a maximum of up to eight tums per month, then the 
particular customer 502 would be able to completely replace his personal inventory twice 

20 per month. 

Provider 504 is illustrated as a single entity for purposes of explanation only. 
Provider 504 may be centralized or distributed depending upon the requirements of a 
particular appUcation. For example, provider 504 may be a central warehouse from 
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which all AA^ items 512 are provided. Alternatively, provider 504 may be implemented 
by a network of distributed warehouses. 

FIG. 6 is a flow diagram that illustrates an approach for renting AA^ items 512, 
e.g., movies, to customers over a communications network such as the Internet using both 
5 "Max Out" and "Max Turns" according to an embodiment. Referring also to HG. 5, after 
starting in step 602, in step 604, a customer 502 enters into a rental agreement with 
provider 504. In the present example, customer 502 uses a generic web browser to access 
an Internet web site associated with provider 504 and enter into a rental agreement that 
specifies that customer 502 may maintain a personal inventory of four movies ("Max 

10 Out" of four) and receive up to four new movies per month ("Max Turns" of four). 
Furthermore, the rental agreement specifies that new movies will be delivered upon 
return of a rented movie from customer 502, i.e., the delivery criteria is a return of a 
movie by the customer. 

In step 606, customer 502 creates and provides movie selection criteria to 

15 provider 504 that indicates movies that customer 502 desires to rent. For example, the 
movie selection criteria may specify particular movie titles that customer 502 desires to 
rent. The movie selection criteria may also specify an order or priority in which customer 
502 wishes to rent the movies. Instead of identifying particular movie titles, the movie 
selection criteria may specify movie preferences for customer 502, e.g., types of movies, 

20 directors, actors, or any other movie preferences or attributes. In this situation, provider 
504 automatically selects particular titles that satisfy the movie selection criteria. For 
example, the movie selection criteria may specify a preference for action movies starring 
a particular actor, with a preference for "new release" movies. Provider 504 attempt to 
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provide movies to customer 502 that best satisfy the preferences indicated by the movie 
selection criteria. 

In step 608, one or more initial movies 512 are delivered to customer 502 over 
delivery channel 514. The one or more initial movies 512 may be delivered to customer 
502 via mail, courier, deUvery agent or any other suitable means negotiated between 
customer 502 and provider and the invention is not limited to any particular type of 
delivery mechanism. For purposes of explanation only, is presumed in the present 
example that movies are mailed between customer 502 and provider 504. 

The one or more initial movies 512 establish the personal movie inventory of 
customer 502. Customer 502 may choose to receive any number of movies up to the 
"Max Out" limit of four movies. TypicaUy, customer 502 will choose to initially receive 
four movies in the initial deUvery. 

Once the one or more initial movies 512 have been mailed to customer 502, then 
in step 610, a determination is made whether any movies 512 have been remmed by 
customer 502 to trigger another movie delivery. In the present example, the delivery of 
additional movies is triggered by the receipt, e.g., via mail, of one or more movies from 
customer 502. In the simation where customer 502 elects to not receive the maximum 
number of movies 5 12 in the initial delivery, then the delivery of additional movies 512 
may also be triggered by a request from customer 502 for additional movies 512. For 
example, customer 502 may notify provider 504 via telephone, email or by accessing the 
web site associated with provider 504. 

If, in step 610, a determination is made that one or more movies 512 were 
received from customer 502, then in step 612, a determination is made whether the 
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maximum number of turns ("Max Turns") limit has been reached for the current cycle. In 
the present example, a determination is made whether four or more movies have been 
mailed in the current month. If not, then control returns to step 608, where one or more 
additional movies 512 are mailed to customer 502 via delivery channel 514 up to the 
5 "Max Out" limit of four. 

If, in step 612, a determination is made that the "Max Tums" limit has been met 
for the current cycle, i.e., in the present example, four movies 512 have been mailed to 
customer 502 in the current month, then in step 614 a determination is made whether to 
override the current "Max Tums" limit. If so, then in step 616, a surcharge is applied to 

10 customer 502 and control returns to step 608 where the additional movies 514 are mailed 
to customer 502. If not, then in step 618, a determination is made whether to continue the 
subscription service. If so, then no additional movies are mailed to customer 502 during 
the current cycle, e.g., the current month, and the control returns to step 610. If, in step 
618, a determination is made that service is not to be continued, then the process is 

1 5 complete in step 620. 

In some situations, customer 502 may desire to increase or decrease the size of 
customer's 502 personal movie inventory by changing the current "Max Out" limit. 
According to one embodiment, customer 502 notifies provider 504, e.g., by telephone, 
mail, email or by accessing the web site associated with provider 504, that customer 502 

20 wishes to change the "Max Out" Emit. The movie rental agreement between customer 
502 and provider 504 is then modified to reflect the change of the "Max Out" limit. In 
the situation where the "Max Out" limit is increased, then additional movies 512 may be 
immediately mailed to customer 502. 
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6, INVENTORY MANAGEMENT 

The approach described herein for renting items to customers provides superior 
inventory management to prior approaches. Specifically, the use of item selection criteria 
provides for efficient inventory management by allowing the greatest number of items to 
5 be rented at any given time. Moreover, the greatest number of customers are provided 
with their most preferred items. For example, customers may specify priorities for the 
items indicated by the item selection criteria. Thus, if a particular customer's first choice 
is not available, or akeady rented, then the item having the next highest priority can be 
rented to the particular customer. According to one embodiment, customers may indicate 

1 0 items that are not yet available for rent. Then, the items are delivered to customers when 
they become available. 

For example, referring again to FIG. 5, suppose that a particular customer 502 
desires to rent an as-yet-unreleased movie entitled "ABC." The particular customer 502 
indicates this movie to provider 504 by the item selection criteria. Since the movie ABC 

15 is not yet available, it cannot be delivered to the particular customer 502. However, when 
the movie ABC does become available, it can be shipped immediately to the particular 
customer 502, as well as other customers 502 who may have also requested the movie. 
This allows provider 504 to maximize the number of items rented while ensuring that 
customers 502 are able to rent the highest priority items that they requested. 

20 According to another embodiment, as yet unknown items may also be rented by 

specifying attributes of the unknown items. For example, the particular customer 502 
may request to rent the next new movie of a particular director, for which the exact name 
is unknown to the particular customer. As another example, the particular customer 502 
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may request to rent the next album of a particular group that is currently in process and 
does not yet have a title. 

7. ITEM RECOMMENDATION 

According to another embodiment of the invention, an approach is provided for 

5 estimating how a user would rate an item that the user has not yet rated. The approach is 
applicable to any type of items, including rental items such as movies and games, and the 
invention is not limited to any particular type of item. The approach is appUcable to a 
wide variety of contexts and is ideally suited for automatically selecting rental items to be 
recommended for rental. 

1 0 FIG. 7 is a block diagram 700 and HG. 8 is a flow diagram 800 that are used 

hereinafter to describe the approach for estimating how a user would rate an item that the 
user has not yet rated according to an embodiment of the invention. Diagram 700 
includes users 702, 704 and an item space 706 that includes items 708, 710, 712, 714, 
716,718. 

15 Referring to HG. 8, after starting in step 802, in step 804, the first step in the 

approach is to identify one or more items that have been rated by the user, hi the present 
example, a determination is made that user 702 has rated items 708, 710. 

In step 806, one or more other users are identified that have rated tiie one or more 
items and given ratings to the one or more items tiiat are substantially similar to ratings 

20 given by user 702 to the one or more items. In the present example, user 704 has rated 
items 708, 710 and has given ratings to items 708, 710 that are similar to ratings given by 
user 702 to items 708, 710. The approach is appHcable to any number of other users and 
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is described hereinafter in the context of a single other user 704 for purposes of 
explanation only. 

hi step 808, an estimation is made how the user would rate the item that the user 
has not yet rated based upon how the one or more other users rated the item. In the 
present example, an estimation is made how user 702 would rate item 716 based upon 
how user 704 rated item 716. The process is complete in step 810. 

Consider the foregoing approach in the context of estimating how user 702 would 
rate a movie 716 that user 702 has not yet rated. In this example, item space 706 is a 
movie space 706 and items 708, 710, 712, 714, 716, 718 are movies. First, movies 708, 
710 are identified as movies that have been rated by user 702. Then, user 704 is 
identified as having rated movies 708, 710 and given ratings to movies 708, 710 that are 
substantially similar to ratings given by user 702 to movies 708, 710. Finally, an 
estimation of how user 702 would rate movie 716 is made based upon how user 704 rated 
movie 716. Thus, the estimation of how user 702 would rate movie 716 is made based 
upon matching ratings across users 702, 704. 

A. Determining Similarities of Ratings 

The particular technique employed to determine similarity of ratings may vary 
depending upon the requirements of a particular application and the invention is not 
limited to any particular approach. For example, the ratings made by furst user 702 may 
be compared to the ratings made by second user 704 on a rental item-by-rental item basis 
to identify one or more rental items tiiat have been rated similarly by the first user 702 
and the second user 704. As another example, ratings made by first user 702 may be 
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compared to aggregate ratings of groups of other users to identify one or more rental 
items that have been rated similarly by the first user 702 and another group of users. 

According to one embodiment of the invention, similarity criteria are used to 
identify users that given substantially similar ratings to items. The similarity criteria 
5 specify a maximum difference in ratings for two or more ratings to be considered similar. 
For example, suppose that users 702, 704 rate items 708, 710, 714, 718 on a scale of zero 
to ten according to table I. 

table: 

rhem user 702 ratings user 704 ratings 

10 708 8.2 7.3 

710 9.3 9.8 

714 8.1 9.2 

718 8.7 6.9 

1 5 Suppose further that the specified similarity criteria require a difference in ratings 

of less than or equal to one for two ratings to be considered sufficiently similar. In this 
situation, rental item 708 is considered to be rated substantially similarly by users 702 
and 704 since the difference between the ratings of 0.9 satisfies the specified similarity 
criteria, namely, that the difference is less than the specified amount of one. Rental item 

20 7 1 0 is also considered to be rated similarly by first and second users 702 and 704 since 
the difference between the ratings is 0.5. Rental items 714, 718 are not considered to be 
rated similarly since the differences between the ratings by first and second users 702, 
704 of 1.1 and 1.8, respectively, are each greater than the specified similarity criteria. 
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B. Estimating Ratings 

As previously described, an estimation is made how the user would rate the item 
based upon how one or more other users have rated the item. In the present example, an 
estimation is made how user 702 would rate item 716 based upon how user 704 has rated 
item 716. According to one embodiment of the invention, ratings made by user 704 for 
items 708, 710 are compared to ratings made by user 704 for item 716. It has been found 
that die similarity of ratings made by users 702 and 704 for items 708, 710 and by user 
704 for item 716 provide a strong prediction of how user 702 would rate item 716. More 
specifically, given that users 702 and 704 rated items 708, 710 substantially similarly, if 
user 704 has rated item 716 substantially similarly to items 708, 710, then it is likely that 
user 702 will also rate item 716 substantially similarly to items 708, 710. The reliability 
of tiiis prediction m practice may vary depending upon a number of factors, such as the 
number of common items rated by users 702 and 704 and the particular similarity criteria 
selected. According to one embodiment of die invention, an average of tiie ratings given 
by user 704 to items 708, 710 is compared to the rating given by user 704 to item 716 to 
estimate how user 702 would rate item 716. In sitiiations where a determination is made 
that user 704 rated item 716 substantially similarly to items 708, 710, tfien there is a 
relatively high likelihood that user 702 would rate item 716 substantially similarly to 
items 708, 710. 

C. Filtering Low Scoring Items 

The approach described herein for estimating how user 702 would rate item 716 
not previously rated by user 702 operates independently of die absolute values of die 
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ratings made by users 702, 704 for items 708, 710, 716. Thus, the approach works 
equally well for identifying items that user 702 is likely to rate favorably, or not 
favorably. 

In some situations, it is desirable to use the approach described to identify items 
that user 702 is likely to rate favorably. This approach may be used, for example, in the 
context of a recommendation engine for identifying items to recommend to user 702. In 
this context, it is desirable to only recommend items which, according to the approach, 
are predicted to be rated favorably by user 702. Therefore, according to one embodiment 
of the invention, specified selection criteria are used to identify items that are likely to be 
rated highly (and therefore enjoyed) by user 702. According to one embodiment of the 
invention, the selection criteria specify a minimum rating. Thus, the selection criteria 
may be used to select the items that have both been rated by the user and that satisfy the 
specified selection criteria, e.g., have been rated favorably by the user. The specified 
selection criteria may also be applied to identify the set of one or more other users by 
requiring that the ratings given to items by the one or more other users be both 
substantially similar to the ratings given by the user and satisfy the specified selection 
criteria. 

D. Controlling the Number of Rated Items 

According to one embodiment of the invention, the number of items that have 
been rated is at least a specified number of items. The specified number of items may 
vary depending upon the requirements of a particular application. Requiring more items 
to be rated generally increases the quality of the estimation of how the user will rate the 
item that the user has not yet rated, albeit at the cost of computational resources and 
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possibly time required to provide an estimation. For example, this requirement may be 
used to require a least a specified number of items rated by users 702 and 704. 

8. IMPLEMENTATION MECHANISMS 

The approach described herein for estimating how a user would rate an item that 

5 the user has not yet rated is applicable to any type of rental application and (without 
limitation) is particularly well suited for Internet-based rental applications for renting 
movies, music and games to customers. The invention may be implemented in hardware 
circuitry, in computer software, or a combination of hardware circuitry and computer 
software and is not limited to a particular hardware or software implementation. The 

10 invention is ideally suited for recommendation engine appUcations and may be 

implemented as a stand-alone mechanism, or integrated into a rental mechanism. For 
example, the approach is ideally suited for identifying rental items, such as movies, music 
and games, to recommend to users. 

FIG. 9 is a block diagram that illustrates a computer system 900 upon which an 

1 5 embodiment of the invention may be implemented. Computer system 900 includes a bus 
902 or other communication mechanism for conmiunicating information, and a processor 
904 coupled with bus 902 for processing information. Computer system 900 also includes 
a main memory 906, such as a random access memory (RAM) or other dynamic storage 
device, coupled to bus 902 for storing information and instructions to be executed by 

20 processor 904. Main memory 906 also may be used for storing temporary variables or 

other intermediate information during execution of instructions to be executed by processor 
904. Computer system 900 further includes a read only memory (ROM) 908 or other static 
storage device coupled to bus 902 for storing static information and instructions for 
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processor 904. A storage device 910, such as a magnetic disk or optical disk, is provided 
and coupled to bus 902 for storing information and instructions. 

Computer system 900 may be coupled via bus 902 to a display 912, such as a 
cathode ray tube (CRT), for displaying information to a computer user. An input device 

5 914, including alphanumeric and other keys, is coupled to bus 902 for communicating 
information and command selections to processor 904. Anotiier type of user input device is 
cursor contirol 916, such as a mouse, a trackball, or cursor direction keys for 
communicating direction information and command selections to processor 904 and for 
controUing cursor movement on display 912. This input device typically has two degrees 

10 of freedom in two axes, a furst axis (e.g., x) and a second axis (e.g., y), tiiat allows the 
device to specify positions in a plane. 

The invention is related to the use of computer system 900 for estimating how a 
user would rate an item that the user has not yet rated. According to one embodiment of 
the invention, estimating how a user would rate an item that the user has not yet rated is 

1 5 provided by computer system 900 in response to processor 904 executing one or more 
sequences of one or more instructions contained in main memory 906. Such instructions 
may be read into main memory 906 from another computer-readable medium, such as 
storage device 910. Execution of the sequences of instructions contained in main 
memory 906 causes processor 904 to perform the process steps described herein. One or 

20 more processors in a multi-processing arrangement may also be employed to execute the 
sequences of instructions contained in main memory 906. In alternative embodiments, 
hard-wired circuitry may be used in place of or in combination with software instructions 
to implement the invention. Thus, embodiments of die invention are not limited to any 
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specific combination of hardware circuitry and software. 

The term "computer-readable medium" as used herein refers to any medium that 
participates in providing instructions to processor 904 for execution. Such a medium may 
take many forms, including but not limited to, non-volatile media, volatile media, and 
transmission media. Non-volatile media includes, for example, optical or magnetic disks, 
such as storage device 910. Volatile media includes dynamic memory, such as main 
memory 906. Transmission media includes coaxial cables, copper wire and fiber optics, 
including the wires that comprise bus 902. Transmission media can also take the form of 
acoustic or light waves, such as those generated during radio wave and infrared data 
communications. 

Common forms of computer-readable media include, for example, a floppy disk, a 
flexible disk, hard disk, magnetic tape, or any other magnetic medium, a CD-ROM, any 
other optical medium, punch cards, paper tape, any other physical medium with patterns 
of holes, a RAM, a PROM, and EPROM, a FLASH-EPROM, any other memory chip or 
cartridge, a carrier wave as described heremafter, or any other medium from which a 
computer can read. 

Various forms of computer readable media may be involved in carrying one or 
more sequences of one or more instructions to processor 904 for execution. For example, 
the instructions may initially be carried on a magnetic disk of a remote computer. The 
remote computer can load the instructions into its dynamic memory and send the 
instructions over a telephone line using a modem. A modem local to computer system 900 
can receive the data on the telephone line and use an infrared transmitter to convert the data 
to an infrared signal. An infrared detector coupled to bus 902 can receive the data carried 
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in the infrared signal and place the data on bus 902. Bus 902 carries the data to main 
memory 906, from which processor 904 retrieves and executes the instructions. The 
instructions received by main memory 906 may optionally be stored on storage device 910 
either before or after execution by processor 904. 
5 Computer system 900 also includes a communication interface 918 coupled to bus 

902. Communication interface 918 provides a two-way data communication coupKng to a 
network link 920 that is coimected to a local network 922. For example, communication 
interface 918 may be an integrated services digital network (ISDN) card or a modem to 
provide a data communication connection to a corresponding type of telephone line. As 

1 0 another example, communication interface 918 may be a local area network (LAN) card to 
provide a data communication connection to a compatible LAN, Wireless links may also be 
implemented. In any such implementation, communication interface 918 sends and receives 
electrical, electromagnetic or optical signals that carry digital data streams representing 
various types of information. 

1 5 Network link 920 typically provides data communication through one or more 

networks to other data devices. For example, network link 920 may provide a connection 
through local network 922 to a host computer 924 or to data equipment operated by an 
Intemet Service Provider (ISP) 926. ISP 926 in tum provides data communication services 
through the worldwide packet data communication networic now commonly referred to as 

20 the "Intemet" 928. Local network 922 and Intemet 928 both use electrical, electromagnetic 
or optical signals that carry digital data streams. The signals through the various networks 
and the signals on network link 920 and through communication interface 918, which carry 
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the digital data to and from computer system 900, are exemplary forms of carrier waves 
transporting the information. 

Computer system 900 can send messages and receive data, including program code, 
through the network(s), network link 920 and communication interface 918. In the Intemet 
example, a server 930 might transmit a requested code for an apphcation program through 
Mtemet 928, ISP 926, local network 922 and communication interface 918. hi accordance 
with the invention, one such downloaded apphcation provides for estimatmg how a user 
would rate an item that the user has not yet rated as described herein. 

The received code may be executed by processor 904 as it is received, and/or stored 
in storage device 910, or other non-volatile storage for later execution. In this manner, 
computer system 900 may obtain application code in the form of a carrier wave. 

The novel approach described herein for renting items to customers provides 
several advantages over prior approaches for renting items to customers. First, the 
decision of what items to rent may be separated from the decision of when to rent the 
items. Customers may specify what items to rent using the item selection criteria and 
receive the items at a ftimre pomt in time, without having to go to the provider to pick up 
the items. The selection criteria may be user specific and may indicate a desired 
fulfillment sequence. Furthermore, customers are not constrained by conventional due 
dates and instead may establish continuous, seriaUzed rental streams of items. The 
approach also allows more efficient inventory management. 

The "Max Out" approach for inventory management allows users to maintain 
their own inventory of items that are periodically replaced by other items according to 
specified event criteria. The event criteria that trigger sending another item to a customer 
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are very flexible and may be tailored to the requirements of a particular application. For 
example, as described herein, the event critaia may include a remm of any of the items 
currently in use by the customer or merely customer notification. This is very convenient 
in the context of movie rentals since a the return of a movie to the provider automatically 

5 triggers the sending of another movie to the customer. The "Max Turns" approach for 
inventory management, when used alone or in combination with "Max Out," provides 
even greater flexibility for customers and providers. The max number of turns can be 
selected individually for particular customers depending upon their particular needs. 
The "Max Out" and "Max Turns" approaches provide great flexibility in 

1 0 establishing subscription models to satisfy the needs of a particular application. 

Specifically, the size and replacement frequency of customer inventories can be tailored 
to each customer with individualized subscription plans. 

In the foregoing specification, the invention has been described as applicable to 
an implementation anticipating Internet based ordering and mail or other long-distance 

1 5 deUvery of the items, where the special advantages of the method are very atti^ctive. 
However the same invention may be applied in a more conventional video, games, or 
music rental-store setting, where subscription customers may be allowed rentals of a 
specified number of movies, games, or music selections at any time, and/or in one 
subscription period, witiiout rental retum due dates, in exchange for a periodic rental 

20 subscription fee. 

In the foregoing specification, the invention has been described with reference to 
specific embodiments thereof. However, various modifications and changes may be 
made thereto without departing from the broader spirit and scope of the invention. The 
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specification and drawings are, accordingly, to be regarded in an illustrative sense rather 
than a restrictive sense. 

Approach for Choosing Items to Recommend Based upon Matching Taste Across 

Multiple Users and Items 

5 

Brief Description 

A system is provided for predicting users' likely enjoyment of an item (such as a 
movie, game, or any other rentable item) based upon matching that user with other users 
who have previously expressed then* taste for a range of similar and dissimilar items. 

1 0 Each user establishes an identity with the system, and records their (numeric) rating for a 
number of items. The ratings may stored in a database. When a prediction is required for 
one of those users (the target users), the system finds other users who have provided ratings 
for an overlapping set of items as the target user, and who have expressed similar ratings for 
those items as the target user. Using these neighboring users ratings, the system calculates 

15 an aggregate of the ratings from the other users as a prediction for the target user for an item 
that the target user has not rated. 

According to one embodiment of the invention, the business is a movie rental 
business. Customers choose DVD movies at an electronic-commerce web site. Movies 
are stored at a central warehouse, and are shipped by US mail anywhere in the US. 

20 Knowledge of users' tastes are used to help recommend movie titles to individuals that 
best match their personal tastes. This benefits users by helping them find movies to 
enjoy, and it aids our business by encouraging movie-watching behavior. Inventory 
levels and other cost metrics may also be used in conjunction with predicted enjoyment to 
help determine what items to recommend that may be fulfilled quickly and cheaply. This 
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approach may be used, for example, with certain pages of the Website, where the 
customer is aware that the movies presented are chosen based upon their input ratings, 
and also impHcitly on other pages of the Website where the system is used to refine 
choices a human editor has aheady made in creatmg a feature display, so that the feature 
5 display can be personalized or tailored to individual users to maximize user enjoyment 
and vendor benefit. 

Display of Predictions 

Once the ratmgs are coUected for a body of users, the system may be used to predict 
how well a particular user will enjoy any other title they have not rated. This may be used to 
1 0 provide a personal, individualized predicted rating ("prediction") for every movie featured 
on the Website. 

Best Bets Page 

According to one embodiment of the invention, this information is used to present a 
"best bets" Web page that features the top movies that a customer might enjoy. Movies for 
1 5 this page are also selected taking into account inventory levels, so that the titles 

recommended to a particular customer are selected from those with the highest rating, for 
which there is adequate stock so tiiat the tides can be shipped immediately. 

Other Dynamic Face Pages 

According to one embodiment of the invention, a Website is provided with a number 
20 of other top-level pages that feature smaU coHections or groups of movies which match 
some editorial theme. These are referred to as "face pages." For example, a collection of 
action movies may be presented and a collection called favorites of mostiy old popular titles. 



56055-0013 



-37- 

The ratings database may be used to predict how much a user will enjoy each movie within 
a collection. For example, for a collection that will be displayed, the editors prepare a list of 
perhaps two or three times as many movies as there is room to display on the web page. 
Each user is then presented with a personalized version of the face page that sorts from the 
5 available list and picks the top movies that will appeal to that specific user. 

Inventory Management 

According to one embodiment of the invention, when determining which movies to 
show to a user, the Website software takes into account not only the predicted ratings for the 
movies to be shown, but also other factors, such as available inventory, the current run-rate 
1 0 for each specific item, the cost to fulfill each item, and any other factors that may affect the 
customer's overall enjoyment of our service. 

Multiple Website Implementation 

Since the quality of the predictions made may depend directly upon choosing the 
best matching neighboring users, it is sometimes valuable to collect ratings from as many 

1 5 users as possible in order to have the best possible selection of other users from which to 
choose neighbors. Li support of this objective, it is possible to offer movie-related web site 
operators the opportunity to the present approach to offer similar recommendations on their 
Websites, while sharing a single database of user ratings. Users of any site contribute 
ratings to the same database. A user from one Website can receive a prediction from a 

20 collection of users who have provided ratings at many different Websites, thus enhancing 
the quality of predictions that any particular Website can make. 
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Common User Identities across Different Websites 

According to one embodiment of the invention, users may provide a screen-name 
for their identity that is accessible from all the different web sites using the system. Thus a 
user who has provided ratings at one Website, may receive predictions at another Website 
5 based upon the same set of ratings akeady provided. 

Collaborative Filtering 

Novel aspects of the collaborative filtering approach include, without limitation: 

• According to one embodiment of the invention, an approach is provided to subdivide 
the system enabling remote subsystems to share a single database of ratings while 

1 0 retaining high performance; 

• According to one embodiment of the invention, a novel user-interface 
implementation is provided to facilitate collection of ratings from the user, and 
simultaneously display predictions to the user for the same item; and 

• According to another embodiment of the invention, an approach is provided 
15 selecting different items to display based upon inventory and other factors, in 

conjunction with the predicted ratings of the items. 



Multi-Website Implementation 

The diagram below shows a possible configuration of components for an intemet- 
20 based recommendation system. 
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Division of the Computation 

The approach for predicting how much a target user will enjoy a particular item 
includes (a) determining how similar the target user's tastes are to each other user in the 
database and computing a similarity weight; (b) choosing a set of representative neighboring 
users who are similar to the target user and who span enough items to make usefiil 
predictions; and (c) multiplying how die neighboring users liked the item to be predicted by 
the similarity weights for the target user, summing and normalizing to get a prediction. 

Steps (a) and (b) can be performed offline, since the results of those computations 
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are manageable in size, and relatively stable over time (at least over a period of days to 
weeks). Step (c) is ideally performed at the time a prediction is required, since the number 
of possible target customers and predictable movies is far too large to calculate in advance. 

According to one embodiment, calculations (a) and (b) are performed close to the 
single master database, in the analyzer component at the main site 1. The remote site 2 is 
connected to the main site by a link whose bandwidth is sufficient to download the pre- 
computed set of neighbors daily, although with high latency. 

New user creates account at site 1 

When a new user visits site 1 and creates a new account, the new user is invited to 
offerratings on items he knows. The ratings are collected by the Webserver. Load 
balancing shares the load between the matching engines, for example, sending customers 
with odd numbered customer IDs to engine 1 , and even numbered customer IDs to engine 2. 
The matching engine records the new customers ratings in the database, and initiates 
computation of the correlation match between the new customer and a pool of pre-selected 
representative customers who's proffles are loaded into the matching engine. These matches 
are used to make immediate predictions about what else the new customer might enjoy. 

Offline Computation 

Later, offline, the analyzer has the opportunity to re-examine the new customer's 
ratings when updating the pool of representative neighbors. If the new customer has 
additional information to contribute to tiie prediction capability of the system, the new 
customer may become part of the pool of representative neighbors used for making 
predictions for aH other users. Also offline, tiie analyzer can periodicaUy recomputed tiie 
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similarity between each user (including the new user) and all the users currently in the 
representative ndghboAood pool. These weightings change gradually as customers rate 
more movies, and as the membas of the representative pool rate more movies. The 
weightings for each customer are stored in the database. 

User returns to site 1 

When a user remms to site 1, his rating record and similarity weights are 
immediately fetched from the database. Predictions can be made by applying calculation (c) 
betwerai the target customer and the pre-loaded pool of representative neighbors. 

User returns to site 2 

If the same customer now visits site 2 for the first time, he is prompted to offer his 
screen name or other identifying characteristic, which enables his rating record and 
similarity weights to be fetched from the database at site 1. The connection between site 1 
and site 2 is fast enough to fetch this small record once per customer session with low 
latency. Site 2 has aheady pre-loaded the same set of representative neighbors, and 
computation proceeds exactly as in the previous case. 

User adds more ratings at site 2 

If the same customer chooses to volunteer more ratings at site 2, to improve the 
profile available from which recommendations are made, those ratmgs will be used locally 
to refine the weights between the user and the locally stored representative neighbors. 
Those ratings will also be batched up and later (within minutes or hours) sent back to the 
master database, where the offline analyzer can examine the new data, and determine how 
the new data affects the selection of representative neighbors for the future. If the new data 
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causes the customer now to be selected as a representative neighbor, then on a subsequent 
(daily) update of the representative neighborhood pool, his data will be uploaded to the local 
and remote matching engines. 

New user creates account at site 2 
5 Similarly, if another new customer creates his account first at site 2, the local process 

wiU initially match that customer up against the preloaded representative neighbors for 
making predictions immediately, and will lata upload the new customer information and 
ratings to the master database for analysis and integration into the overall matching 
database. 

10 Alternative approaches 

Duplicate databases 

One alternative approach is to provide a duplicate database at the remote site 2, so 
that site 1 and site 2 could operate independently. A periodic (nightly) process would run to 
synchronize the data between the two databases. Such a synchronization process would be 
1 5 complex, and would likely require huge bandwidth between the two databases. 

Site 2 has remote access to matching engines on site 1 

Another altemative places the matching engines dedicated to site 2 physically at site 
1 , close to the single master database and analysis process. This is computationally and 
logically simpler, but each rating submission and prediction request requires a round-trip 
20 communication between the webservers at site 2 and the matching engines at site 1 . Typical 
site operations require thousands of predictions a second, requiring huge bandwidth, at very 
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low latency, to make this function with adequate performance (predictions in sub-second 
times). 

Advantages of the proposed approach 

Among the benefit of the architecture described is that the volume of data to be 
exchanged with low latency is quite small, and only happens once per customer visit. For 
example, a site might have 100,000 visitors per day, each requiring 100 ratings and 100 
weights to be uploaded immediately, and resulting in an additional 10 ratings to be sent back 
later. Each visitor might visit 20 pages, requiring a total of 1000 predictions per visitor, or 
lOOM predictions per day. 
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Example Embodiments: 

4.9 A system to make predictions on user-taste (e.g., customer-taste) at a number of 
different network resources, e.g., Websites, whose servers are separate, e.g., physically 
remote from each other. 

5 0 where a master database services recommendation engines at each remote site. 

0 where an analysis process at the main site pre-computes a set of representative 
neighbors for all the sites to use. 

0 where a local analysis process at the remote sites performs immediate local matching 
for prediction for a new customer, but forwards the new customer ratings to the main site 
1 0 for detailed analysis. 

0 where the remote sites are connected to the main site via a dedicated data link. 

0 where the data link has low latency, but bandwidth inadequate for carrying traffic for 
every prediction made, and inadequate for replicating and merging the entire database 
regularly. 

1 5 0 where a customer' s ratings input at any site are used to make predictions for that 
customer when he visits other sites. 

0 where customer's ratings are migrated from one site to another. 
0 where a customer's ratings are remotely accessed by another site. 
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0, 0, 0, 0, and 0 where the items being rated and enjoyment predicted are movies. 
0, 0, 0, 0, and 0 where the items being rated and enjoyment predicted are games. 
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Multi Purpose Graphical User Literface Control 
Hitesf OK Otei Rsillyli^ Lewd 




According to one embodiment of the invention, a row of stars is used to represent ratings for 
a movie. There are several dimensions that may be displayed as stars: 

• A user' s input rating on a specific movie 

• A personal, individualized prediction about a specific movie 

• The average rating of all users on a specific movie 

• Editorial ratings (such as by well-known critics) on a specific movie. 
When a particular user is unknown, a personalized prediction or rating cannot be 

displayed. Once a user has rated sufficient otiier movies to provide confidence in predicting 
a rating for this movie, a prediction can be shown. If the user has seen the tide, our 
prediction may differ firom the user's actual level of enjoyment, and tiie user can enter his 
actual rating to help tiain the recommendation engine for future predictions. If the user has 
entered a rating, the prediction wiU be identical to his rating. 
According to one embodinient of the invention, a graphical interface device is used to: 

• Display no rating and invite users to click on it to input a rating: 




• Display an output prediction, and still invite users to click on it to help refine our 
recommendations engine database: 
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• Serve as an input device where a user can click to enter a rating: 




A single row of stars may be used that are empty outlines for the no-ratings case, are 
5 colored red for an output prediction, and colored gold to represent an input rating. 

Dynamic image changes to attract input 

One feature is making the image obviously a way to input a rating too. This may be 
accompUshed by dynamicaUy changing the image as the user's mouse passes over the 
image. As mouse moves over a particular star, the predicted rating red filled stars disappear, 
10 and the star under the mouse and all stars to the left of it are replaced with the gold input 
rating star. Simultaneously, the words above the image change to "click rate movie". As 
the mouse drags left and right over the stars, the appropriate star outlines are outlined or 
filled in to give the impression that the user is dynamically changing the rating. 



15 Smooth updates 

According to the "smooth updates" approach, when the user finally cHcks on a star, 
the JavaScript redisplays the stars image displaying the users input, and revises the adjacent 
words to show an input accepted. Also, the web browser sends the input ratmg to the web 
server (by posting a form) and waits for a response. Normally, this would cause the web 
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server to compute a new page and send it to the browser for display, which involves a 
iDund-trip communication which could be anywhere from fractions of a second to tens of 
seconds if the user is on a slower dial-up Une. 

One aspect of this approach is for users to be able to enter many ratings as smoothly 
as possible, so a novel technique is used to not update tiie web browser window. The web 
server first records the user's input. The web protocols require that it respond, which it does 
by creating a new page and requiring that the cUent machine create a new window to display 
that page. The new window is as smaU as possible, and where possible is positioned off the 
visible screai of the cHent machine. The page that is sent to the new window contains only 
the JavaScript commands to make the window invisible. Together, these techniques ensure 
that the end-user is only minimally aware that anything was repainted or redisplayed. 

Display of confidence 

According to another embodiment of the invention, the prediction engine provides a 
confidence level for each individualized predictions. Confidence information may be 
separately represented using color to represent confidence (from watery pastels for low 
confidence to bright primary colors for high confidence). An alternative implementation is 
to use size of the images to represent different confidence levels, or a different graphical 
scale alongside. 

Implementation Examples 

According to one embodiment, the rows of stars are assembled as an HTML table 
with 10 slots. JavaScript selects appropriate images to fill the cells of the table, and 
responds to mouse movement by dynamicaUy changing the images to present the proper 
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animation and pictures. There are six images, being the half stars each in white, gold, and 
red. 
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In an alternative embodiment, there are 21 distinct images for the whole row of stars, 
represaitmg the 5 empty stars image, and ten versions each of gold and red stars. An Image 
Map maps regions of the single bar of stars image into regions, and JavaScript selects and 
loads the appropriate composite unage based upon which region the mouse is over. 
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According to another embodiment of the invention, star images are used that have 
transparent centers, where the color changes are effected by the JavaScript by varying the 
background color of the table cells where the stars are laid out. In the figures above, the 5 
stars permit 10 or 1 1 possible values by permitting half-stars to be colored. The 
implementation could equally well use whole stars (5 or 6 ratings) or other fractions for 
different granularities. 
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Example Embodiments: 

5.6.1 Use of a single graphical user interface device to display output and capture input 
on a web-browser or other type of transaction-oriented system. 

0 where the output display (e.g. a prediction) is of a different parameter than the input 
5 parameter (e.g. of a rating). 

0 where a linear graphical display is used to input quantized numerical ratings. 
0, 0, and 0 where confidence in results is displayed graphically 
0 where color and/or size is used for confidence display 

Technique for simulating one-way updates of data from the web-browser to the web- 
1 0 server without requiring a page update on the web-browser. 

0 based on the web-server sending a minimal response to a separate browser window 
hidden from the user's view. 

0 where the response is sent to an embedded iframe in the browser 

0 where the iframe displays a relevant response, such as a count of the number of 
1 5 customer inputs, that changes as the customer interacts with the interface. 

0 using client-side JavaScript to update the page seen by the user immediately, avoiding 
the need for a round-trip delay to the web-server. 
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0 - 0 where the user interface is connected to a system for accepting ratings for and 
making predictions on taste for items. 

0 where the items being rated and predicted are movies. 

0 where the items being rated and predicted are games. 

Techniques for Inventory Management for an Electronic Commerce Rental Business 
An on-line electronic-commerce business has exceptional ability dynamically to 
tailor its merchandising (or more generally, its product presentation, advertising, and 
promotional displays) to particular individuals who visit the store web site. This invention is 
a process for managing different presentations of product for each visitor to a store with a 
view to managing inventory effectively. 

Consider the example of a movie rental business. Customers choose DVD movies at 
an electronic-commerce web site. Movies are stored at a central warehouse, and are shipped 
by US maU anywhere in the US. A key business concern is satisfying the biggest possible 
demand for a specific title with the smallest possible number of copies of that title. 

As in a physical store, product positioned in certain strategic locations in the store is 
consumed more frequently than if the same product is positioned in less visible parts of the 
store. By modulating which titles get the key positions in the store, the demand for each titie 
can be controlled dramatically. In an electronic commerce store, the key locations are the 
home page and the other top-level "face pages" that feature a small number of movies along 
with box shots and editorial commentary. 
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For each face page (more generaUy, for each context), the titles to be displayed are changed 
for each customer who visits the store, and each visit they make, based upon a variety of 
factors. The web-server is programmed to consider all these factors, select appropriate 
movies, construct a page dynamically, and send the HTML code for that page to the 
customer's web browser for display. Each time the page is requested, a different result can 
be generated. 

According to one embodiment of the invention, the general model for selection of 
titles is logically viewed as a series of cascading filters and prioritizers: 



Editorial Selection 
of titles appropriate 
to context 



Elimination 
of titles not currently 
in stock 



Elimination 
of titles that the 
customer IS known to 
have rented before 



Prioritize movies 
to match tastes of 
mdividual customer 



Prioritize movies 
by days supply 
in inventory 




Movies shown to 
customer 



1 0 Consida a section of a face page presenting a feature about movies with great 

soundtracks. Starting from the catalog of aU DVD movies available, a filter picks the 
movies chosen by the store editorial staff as being the movies with great sound. This is done 
by associating a context keyword ("great_sound") against the catalog entry in tiie movie 
content database. The filter picks out all titles firom tiie catalog witii that associated 

15 keyword. 

The next filter eliminates (or equivalently, sti-ongly downgrades in priority) all tities where 
tiiere is not a minimum level of stock. If there are zero copies in inventory, tiiere is no point 
in using valuable store space to present it to a potential customer. 
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The third filter eliminates titles known to have been previously rented or viewed by 
the particular customer. For a new visitor with no known history, this filter is null, of 
course. Customers wishing to rent a titte a second time can still find it by searching, or by 
reviewing their previous rental history. Priority space in the store should be focused on 
titles likely to be most appealing to each individual visitor. If a customer has already 
ordered or queued up particular titles for future delivery, these too can be excluded at this 
stage. 

The fourth step is the recommendation engine. This matches the known ratings of 
the current visitor against a large database of other visitors, and ranks titles by expected 
appeal to the target visitor, taking into account the confidence of the predictions fix)m the 
engine. This step does not eliminate any tities, it simply brings to the top of the Ust the titles 
expected to be most appealing. For a new visitor with no ratings in tiie database against 
which to match his tastes, tiiis filter simply ranks the tities by average ratings across die 
whole population of customers who have rated each title in tiie filter list. 

The fifth filter step examines days' supply outstanding for each tide: tiiis is tiie 
number of copies on hand, divided by the average of the daily consun^tion of tiie tide 
during tiie previous days, considering tiie most recent 14 days of shipping behavior. This 
figure approximates tiie number of days tiiat tiie current supply would last, assuming no 
change in recommendation priority, and no retiuned copies. For tiie tities tiiat enter tiiis 
filter step witii aU otiier factors bemg equal, tiiose tities tiiat have more days outstanding of 
stock will be elevated in priority over tiiose having fewer. The reason for using DSO as tiie 
priority metiic instead of just current invaitory level is so that equal consideration is given 
to a specialty interest tide witii small total inventory and small average run-rate as is given to 



56055-0013 



-55- 

a broad-appeal title with huge inventory and huge average run-rate. Other information 
about pending shipments from the warehouse, such as orders for items for fiimre delivery, 
can also be applied to the DSO metric. What matters is that there be a prioritization scheme 
that measures the ratio of inventory to some metric of actual or predicted run-rate which can 
be used to modulate presentation of otherwise attractive items to the customer. 

This last filter step also acts as a govemor on new-release promotion. For the first 
few weeks of a new tide's release, natural demand, un-augmented by featured presentations 
of the title on face pages, drives high average run rates. At the same time, the number of 
copies on hand is currently low, as the proper number are purchased incrementally to 
respond to the acmal demand. As the newness of the title fades, the demand from customers 
actively seeking out the title fades, and the DSO number climbs rapidly, elevating the 
priority of the tide. This happens with similar priority regardless of whether die tide has 
been a 1,000-a-day tide accumulating 20,000 copies in inventory, or a 10-a-day tide 
accumulating 2,000 copies in inventory. 

For customer trust, it is important diat die inventory piioritizer have much lower influence 
on die tides presented than the recommendation engine predicting titles for die specific 
customer based upon his recorded ratings of otiier movies. A logaridimic ti:ansfer function 
is also appropriate on diis filter too, as differences near die low-end of DSO are far more 
significant dian differences at the higher DSO numbers. 

Alternative Embodiments 

Witii diis approach, a relatively large amount of demand may be distributed over a small 
number of copies of a particular tide, which is appropriate for a rental business where die 
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cost of a rental is miniinized by increasing the number of turns and the length of time for 
which it turns. For a product seU-through application, the filters might emphasize other 
aspects of inventory, such as the proxunity of volume purchase discounts, opportunities to 
feature titles by a distributor with whom especially favorable terms have been negotiated, or 
even accessibility of particular titles in a complex network of warehouses (emphasizing 
titles in the short-term or high-cost zones of the warehouse). 

This approach is applicable wherever product can be differently featured to 
individual consumers, or small classes of consumers. The example appUcation described 
above uses an electronic commerce Website to present different rental items to each 
customer. An altemative application domain related to direct marketing: one-to-one 
outbound advertising carried by electronic mail, or physical mail, where each piece is 
tailored to the specific recipient based upon his tastes and available inventory. 
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Example Embodiments: 

6.2.1 Technique for using real-time inventory metrics in prioritizing which merchandise 
to promote within an electronic commerce store. 

0 where the real-time inventory metrics are approximated. 

5 0 and 0 where inventory metrics are linked with a recommendation engme that predicts 
customers' Hkely enjoyment for an item based upon a database of their coUected 
enjoyment ratings for other items. 

Use of a metric that is or approximates the ratio of current inventory to actual or 
predicted natural shipping rate (die days supply outstanding metric) in managing rental 
1 0 inventory to prioritize items by availability. 

0, 0, 0 and 0 when used to manage an outbound e-mail or physical maU dkect marketing 
campaign - featuring different content to each specific recipient. 

Approach for Renting Content Products 

Introduction 

15 An approach is described for renting digital and analog content products, such as 

movies, music, games, and computer software, where the products are dehvered to the 
customer for a rental period either in the form of a physical medium, or in electronic form 
via the Intemet. 

Various aspects of the invention include: 

20 • a rental model that permits substitution of physical and electronic media 
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• a rental model for electronic content that contemplates the renter-user deleting or 
removing the electronic copy at the end of the rental period 

• security concepts that limit fraudulent use of the electronic media after the rental 
paiod is terminated. 

5 Subscription Rental Model 

Content products, such as movies, music, games, and computer software have a high 
value, but are easy to copy. Once a customer has obtained a copy of the product, either on 
physical medium, or in electronic form, it is hard to take it away again. Accordingly, most 
commerce in such products is either a sale of the product for the unlimited use of the 

1 0 individual (e.g. sale of computer software), or free access to the content with support from 
revenue from sale of accompanying advertising material (e.g. TV broadcasts). 

Alternatively, as with digital movies in DVD (Digital Video Disc) format, a copy 
protection scheme is employed to make it hard to copy the digital content. This means that 
the physical disc can be rented for individual use for a limited period, with some confidence 

1 5 that upon proper return of the physical disc at the end of the rental period, the user is unable 
to retain the ability to enjoy the entertainment in unlimited fashion. This justifies a reduced 
price for a disc rental compared to a disc sale. 

The approach generally involves furnishing content products to customers 
electronically without any physical medium being transferred. The approach also 
20 includes a program where a customer may subscribe for the right to hold N items out at 
any one time, and may specifically choose which items are to be delivered on physical 
media (such as a disc), and which items are to be delivered in electronic form. At any 
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time (subject to the program constraints on total number out and number of turns per time 
period), the customer may choose to relinquish rights to an electronic copy of one content 
product and have a physical copy of that or a different content product to replace it, or 
vice versa, may choose to return a physical medium containing a product and replace it 
with an electronic copy of that or a different product. 

Relinquishing the rights to the electronic copy might involve deleting the digital 
bits from a computer hard-disc, deleting the Ucense keys which provide access to those 
digital bits, or interacting with the software application that manages those bits on die 
hard-disc such that the application deletes the digital bits and signals to the server process 
that new product may now be downloaded. Other schemes are possible - the principle is 
that the user is no longer able to access and use the content, whether by legal license 
constraint, by physical constraint (such as removal of the content), or by encryption 
constraint (by removal, change, or expiry of keys that unlock or enable the content to be 
used). 

The approach also includes additional rental equivalence rales, such as different 
limits on number out and number of tums for both physical and electronic versions. For 
example, a program might permit N physical discs, and M electronic discs where 

N + M/2 <= 4 

or indeed any other algebraic formulation to govern how much or how many products 
may be held. 

Use of a Rental Queue 

According to another embodiment of the invention, each customer is allowed to 
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buM and maintain a possibly ordered or prioritized queue or list of the products the 
customer wishes to use, and the rental provider automatically provides a replacement 
product when the customer returns a current rental. The queue of items to be rented might 
contain an indication of the customer' s preference as to what forms of the product are 
5 acceptable or preferred (dther physical media, or electronic download.) 

Management of the Download Process 

According to another embodiment of the invention, a software feature or tool is 
provided to manage the electronic transfer and relinquishment of tiie content product. This 
tool secures space on the customers computer or entertainment appliance to store one or 

1 0 more content products, and arranges to download the product electtonicaUy. For example, 
the product might be downloaded across the Litemet, or using a Cable TV channel or 
wireless broadcast channel or other electronic delivery network. The product might be 
delivered end-to-end in digital form, or the product might be reduced to analog form for 
some stage of the delivery (e.g. across an analog cable TV channel). 

1 5 The management tool may have the capability to manage inaemental or piece-meal 

delivery of the product, perhaps using an unreliable delivery channel, and re-assembling the 
increments in order at the customers appliance, requesting re-transmission of any missing 
parts. 

The management tool may have the capability to deal with planned or unplanned 
20 disconnection of the transmission medium, and resume accessing the product as and when 
the transmission medium is again accessible. 

To serve in the rental context, the tool may also have the featiire that it will delete 
and expunge a content product that is no longer required by the user, and signal to the rental 
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system that a new product may be downloaded to replace the deleted one. 

Example Forms of Transmission 

While the invention is not limited to any particular type of electronic transmission to 
convey the content to the user, several example variations are described herein. According 
to one embodiment of the invention, content is delivered from a server computer at the 
provider's site, aaoss the Internet to the user's laptop or mobile computer connected to the 
Intemet at an office or other location having a high-bandwidth connection to the Internet. 
Various standard caching schemes may be used to facilitate conveyance of the data across 
the Intemet, including proxies and forward-caching servers. Once all the content is 
downloaded onto flie user's mobile computer, the user physically takes the mobile computer 
to the location where the content is to be enjoyed. For example, a user might take a laptop 
and connect it to their television screen and home theatre sound system in their home in 
order to view a movie. This permits content to be enjoyed while the laptop is not connected 
to the Intemet, or is connected to the intemet via a low-bandwidth connection across which 
delivery of digital movies is impractical. 

According to another embodiment of the invention, die laptop computer itself is 
used to enjoy watching the downloaded movie, in a location such as an airplane or hotel 
room. In this way a business traveler might take along entertainment for his trip without 
carrying any additional physical equipment other than his usual business computer. 

Accordmg to another embodiment of the invention, die dovraload is across die 
Intemet to a computer with high bandwidth access, and the content is stored on a removable 
physical medium such as a magnetic disc cartridge (e.g. a Jazz drive) or a solid-state 
memory component (e.g. a "Sony memory stick") which is then conveyed to a second 



56055-0013 



-62- 

similar computer or laptop where the movie is to be viewed. 

According to another embodiment of the invention, the download is mediated by a 
computer connected to the Internet, but the data is conveyed to a specijac entertainment 
appliance, designed explicitly for playing of movies or music (e.g. an appliance similar to a 
5 Rio MPS player). 

According to another embodiment of the invention, high bandwidth Memet 
connections to mdividual homes or residences are employed, and additional local area 
networking Unking the home computer to entertainment appliances is provided. This allows 
the data to be downloaded to the disc storage on the computer in the home office, and then 
1 0 streamed from that computer to a display device connected to a home-area Ethernet Mnk. 

A different approach uses a proprietary distribution network, such as a dedicated 
video delivery network wired specifically to homes and residences. A cable TV distribution 
networic is an example of such a proprietary distribution network, that is not necessarily 
connected to the Memet. 
1 5 Yet another approach might use a broadcast transmission medium, such as unused 

channels of a satellite TV broadcast system or microwave Unk system. 

These descriptions are intended to be examples of content transmission media, and 
are not intended to limit the scope of the invention. 

Security, Rights Management, Fraud 
20 M certain contexts, the renting users are highly trusted, and a license agreement that 

regulates the usage of the electronic copies of the content product is sufficient for both 
parties to be confident that the agreement is being observed. The license agreement might 
specify penalties for abuse of the agreement, and even permit an auditing of the customers' 
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appliances to validate that the agreement is being observed. More generaUy, some technical 
solution may be preferred that makes it harder for the customer to continue to use the 
content after its rental period has expired, or that makes it easier for the provider to detect 
such fraudulent use of the content. 

Encryption 

An aspect of this invention considers that the content will be encrypted using a 
standard encryption algorithm (such as DES) from the provider, through the transmission 
medium, and when stored on the user's computer disc or appUance. According to this 
approach, a suitable key is furnished to the user that permits the content to be decrypted 
within a given context. Such contexts might include the IDs of the user's computer or 
appUance (or some component on that computer or appliance), or a time window. For 
example, a key might require the user's computer's Ethemet MAC address, the serial 
number of their processor before it would be complete and would permit decryption of the 
content. As another example, the key might encode a date, and if the timestamp on the 
user' s computer' s file system is later than that date, the key no longer authorizes decryption 
once that date is passed. Combinations of date and location based constraints might be 
employed. 

Watermarking 

Given that the encrypted content must be decrypted at some point in order to be 
useful to the consumer, any encryption-based enforcement of rental periods is always 
subject to the user providing a modified version of the end-use tool that captures the 
decrypted data and stores it for subsequent use. The best that encryption can do is to make it 
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harder and less interesting for the user to "crack" the system and gain access to the content 
in un-encumbered form, while making it easy to use in compliance with the rental 
agreement. 

According to another embodiment of the invention, watermarking is used, or adding 
5 to the useful content hidden data that identifies flie source of data. If such watermarking is 
employed, a user who obtains access to the decrypted data is still carrying around data that 
identifies who might have broken a license agreement. This serves as a further disincentive 
for the user to attempt to gain use of, or especially to circulate, an unrestricted copy of the 
content. Combinations of licensing, encryption, and watermarking are also contemplated to 
1 0 provide protection for content such as movies or music to be distiibuted under rental terms 
in this form. 

Updateable Security 

According to anotiier embodiment of the invention, download of new decryption 

software is provided along with the content products. This allows subsequent content 
1 5 products to be delivered witii a completely different encryption scheme, which is 

incompatible with any scheme previously used. If a hacker has compromised the previously 

used security scheme, all future product deliveries can be made with a new encryption 

scheme that has not been compromised, thus limiting the damage that the hacker can cause. 

The software application on tiie users machine receives the updated decryption module as 
20 downloaded, and may automatically installs it on the machine (possibly subject to user 

confirmation or agreement). 

In one mode of operation, tiie new decryption module replaces the old, and any old 

content must be replaced by equivalent content that has been encrypted with the new 
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encryption scheme. In another mode of operation, the new decryption module is installed in 
parallel with the old, and the appropriate decryption module is used for content encoded in 
the old and new schemes. The old decryption module might remain installed indefinitely, or 
it might be uninstalled automatically after a period of time, or after all content that is 
encrypted with the old scheme has been removed from the users machine. There need be no 
limitation on the number of old decryption modules installed. 

Multicast Management 

While the invention has been described in terms of a one-to-one communication 
of the content, this is not a requirement of the invention. Especially if the data is 
encrypted, it is desirable to broadcast popularly requested content widely, and then 
provide the keys to unlock tiie data to the specific locations where it is autiioiized for use. 
This makes for much more efficient use of tiransmission bandwidth, since much of die 
data can tiraverse segments of the Oransmission channel once for all the recipients 
downsti:eam of tiiat segment, instead of tiraversing the segment repeatedly for each 
recipient. 

Example Embodiments: 

1 . A subscription rental model for digital or analog content products such as (but not 
limited to) movies, music, games, and software: 
1.1.1 where the content may be fiimished electronically; 

1 .2. 1 where the rental user may choose either electi-onic or physical delivery media on 
an interchangeable basis; 

1 .3. 1 where the limitations on how many items are rented is contirolled by a formula 
that conti-ols how many electronically and how many physically delivered items are 
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authorized. 

2. 1 where a rental queue or list is used to manage the delivery of items: 

2.1 , 2 where the queue contains a flag or an indication about which kind of delivery is 
required for each item. 

3. 1, and 2 where the download process is mediated or managed by an application on the 
renters computer or appliance: 

3.1.3, with provision for deleting and relinquishing rights to the content previously 
downloaded; 

3.1.1. 3.1 with provision for requesting the next item to be rented; 

3.2. 3, where the application handles interruptions, disconnections, or changes in the 
download process to ensure that the whole product is available to the user. 

4. 1 , 2, and 3 where the product is delivered via the internet: 

4.1. 4 where delivery is to a laptop, mobile computer, or other mobile information 
appliance; 

4.1 .1 . 4.1 where the mobile appliance is then carried to the end-use location for 
using or viewing the content without having to remain connected to the 
intemet; 

4.2. 4 where delivery is to a computer or information appliance connected to the 
Intemet: 

4.2.1 . 4.2 where the computer or information appliance is connected to a local area 
network for local distribution and use of the content by the renter's site or 
home, 

4.3. 4 where delivery is to a computer or information appliance connected to a dedicated 
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or proprietary distribution network such as a Cable TV network, broadcast network, 
or satellite receiver 

4.3 . L 4.3 where the computer or information appliance is mobile as in claim 4.1; 
43.2. 4.3 where the computer or information appliance is connected to a local area 
5 network as in claim 4.2. 

5. 1,2, 3, and 4 where the content is encrypted to protect the rights of the owners of the 
content: 

5.1.5 where the encryption ties the content to a specific computer, software installation, 
network address, or other physical control item. 
10 5.2.5 where the encryption ties to a date or time period after which the content cannot 
be decrypted. 

5.3. 5 where both time and location are encoded in the encryption; 

5.4. 5 where a watermark is used to encode identifying information which would be 
redistributed if the content were subsequentiy circulated fraudulently. 

15 5.5. 5 where a watermark is used in conjunction with encryption as in claims 5.1, 5.2, or 
5.3. 

6. 5 where the security modules may be replaced by new modules supporting a new 
security scheme; 

6.1. 6 where the new security module is automatically updated using a similar transport 
20 mechanism to the content itself - for example downloaded across the intemet, or 

delivered on the front of the physical medium on which the content product is 
delivered 

6.2. 6.1 where tiie new security module automatically replaces the previously installed 
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security module. 

63. 6.1 where the new security module resides alongside any previous security 
modules, which can be removed or uninstalled either automatically after a time 
period or when no longer required, or manually. 
5 7. 1 , 2, 3, 4, 5, and 6 where the content is delivered via a multicast arrangement in which 

several possible renters of the content are equipped to receive an encrypted copy of the 

content, and only those who are authorized to use the content receive a personalized key 

to unlock the content 
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